In this book, matrices and their algebra have been introduced from the beginning. So, the addition, multiplication, determinants, adjoint and inverse of matrices with concrete examples have been discussed properly. For advanced students, rank, vector spaces, with row and column spaces of matrices have been given in detail. Some new chapters on geometrical transformation, bilinear forms, quadratic forms, Hermitian forms and similar matrices are dealt with at specific length to give the book a self contained feel. Conceptual, theoretical as well as numerical problems have also been included. Many important problems have been solved and graded exercises are given at the end of each section. This book caters to the needs of undergraduate students of engineering, physics, computer graphics, economics, psychology and other branches.